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Abstract 

Recently the theory of widths of Kolmogorov (especially of Gelfand 
widths) has received a great deal of interest due to its close relation- 
ship with the newly born area of Compressed Sensing. It has been 
realized that widths reflect properly the sparsity of the data in Signal 
Processing. However fundamental problems of the theory of widths 
in multidimensional Theory of Functions remain untouched, and their 
progress will have a major impact over analogous problems in the the- 
ory of multidimensional Signal Analysis. The present paper has three 
major contributions: 

1. We solve the longstanding problem of finding multidimensional 
generalization of the Chebyshev systems: we introduce Multidimen- 
sional Chebyshev spaces, based on solutions of higher order elliptic 
equation, as a generalization of the one-dimensional Chebyshev sys- 
tems, more precisely of the E'CT-systems. 

2. Based on that we introduce a new hierarchy of infinite-dimensionaH 
spaces for functions defined in multidimensional domains; we define 
corresponding generalization of Kolmogorov's widths. 

3. We generalize the original results of Kolmogorov by computing 
the widths for special "ellipsoidal" sets of functions defined in multi- 
dimensional domains. 

MSC2010: 35J, 46L, 41A, 42B. 
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1 Introduction 

It is a notorious fact that the polynomials of several variables fail to enjoy 
the nice interpolation and approximation properties of the one-dimensional 
polynomials, and this is particularly visible in such fundamental areas of 
Mathematical Analysis as the Moment problem. Interpolation, Approxima- 
tion, etc. One alternative approach is to use solutions of elliptic equations, in 
particular polyharmonic functions, which has led to new amazing Ansatzes in 
multidimensional Approximation and Interpolation [17], [15], [13], [24], [18], 
in Spline and Wavelet Theory [32] , [22] , and recently in the Moment Problem 
[26] . This approach has been given the name Polyharmonic Paradigm [22] , as 
an approach to Multidimensional Mathematical Analysis, which is opposite 
to the usual concept which is based on algebraic and trigonometric poly- 
nomials of several variables. However the effectiveness of the Polyharmonic 
Paradigm has remained unexplained for a long time. 

One of the main objectives of the present research is to find a new point of 
view on the longstanding problem of finding multidimensional generalization 
of Chebyshev systems: In Section 2 we show that the solution spaces of a wide 
class of elliptic PDEs (defined further as Multidimensional Chebyshev spaces) 
are a natural generahzation of the one- variable polynomials as well as of the 
one-dimensional Chebyshev systems.^ In particular, this shows that the poly- 
harmonic functions which are solutions to the polyharmonic operators are a 
generalization of the one-variable polynomials. Let us recall that there has 
been a long search for proper multidimensional generalization of Chebyshev 
systems. The standard generalization by means of zero set property fails to 
produce a non-trivial multidimensional system which is the content of the 
theorem of Mairhuber, see the thorough discussion in [29] (chapter 2, section 
1.1). Our generalization provided by the Multidimensional Chebyshev spaces 
comes from a completely different perspective, by generalizing the boundary 
value properties of the one-dimensional polynomials.^ 

^Recall that the one-dimensional Chebyshev systems appeared as a generahzation of 
the one- variable algebraic polynomials in the works of A. Markov in the context of the 
classical Moment problem. They were further developed and applied to the generalized 
Moment problem and Approximation theory by A. Haar (the Haar spaces), S. Bernstein, 
M. Krein, S. Karlin, and others, cf. [29], [20], [34]. 

^In general, zero set properties and intersections are not a reliable reference point 
for multidimensional Analysis. In particular, let us recall that polyharmonic (and even 
harmonic) functions do not have simple zero sets, although they are solutions to nice BVPs 
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On the other hand the cornerstone of the present paper is an amaz- 
ing though simple characterization of the A^— dimensional subspaces Xj^ of 
(jN-i i^j^ (here I is an interval in M) via Chebyshev systems. This charac- 
terization says that the typical subspace Xn is a finite-piecewise Chebyshev 
space, or to be more correct, finite-piecewise i^CT-system. This discovery 
causes an immediate chain reaction: by analogy, for a domain D C IR", 
wc use the newly-invented Multidimensional Chebyshev spaces to define in 
L2 (D) a multidimensional generalization Xn of the spaces Xn, which we call 
" spaces of Harmonic Dimension N" . These spaces Xn represent a new hier- 
archy of infinite- dimensional spaces. Hence, the big surprise of the present 
research is the reconsideration of the simplistic understanding that the natu- 
ral generalization of Xn is provided just by the finite-dimensional subspaces 
of L2 {D) . We realize that the finite-dimensional subspaces in (D) , for do- 
mains D C for n > 2, do not serve the same job as the finite-dimensional 
subspaces in (D) for intervals D G M}, and one has to replace them by 
a lot more sophisticated objects, namely by the spaces having Harmonic 
Dimension N. 

Respectively, the focus of the present research is, by means of the spaces 
Xn to define a multidimensional generalization of the Kolmogorov-Gelfand 
A^— widths, which we call "Harmonic iV— widths" . After that we compute the 
Harmonic A?"— widths for "cylindrical ellipsoids" in L2 (-D) , by generalizing 
the original results of Kolmogorov. 

Another important motivation for the present research is the recent in- 
terest to the theory of widths (especially to Gelfand widths) coming from 
the applications in an area of Signal Analysis, called Compressed Sensing 
(CS). In a certain sense the central idea of CS is rooted in the theory of 
widths, cf. e.g. [10], [8], [9], [37]. However, apparently this strategy works 
smoothly only in the case of representation of one-dimensional signals, while 
an adequate approach to multivariate signals is missing - one reason may be 
found by analogy in the fact that the theory of Kolmogorov-Gelfand widths 
fits properly only for one-dimensional function spaces (as pointed out below, 
e.g. in formula (27)). Recently, a new multivariate Wavelet Analysis was 
developed based on solutions of elliptic partial differential equations ([22]), 
in particular "polyharmonic subdivision wavelets" were introduced (cf. [11], 
[27]). In order to apply CS ideas to these wavelets it would require essential 
generalization of the theory of widths for infinite-dimensional spaces, and it 
is expected that the present research is a step in the right direction. 

In his seminal paper [21] Kolmogorov has introduced the theory of widths 
and has applied it ingeniously to the following set of functions defined in the 

as (38)- (39), cf. [18]. 
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compact interval: 



K, |/ e AC^-' {[a,b]) : |/(^) it)fdt < l| . (1) 

In the present paper we study a natural multivariate generalization of the 
set Kp which in a domain B C is given by 

K; |m e i/^^* {B) : y lA^M da; < l| , (2) 

n 

where is the p— th iterate of the Laplace operator A = ^^d^/dx^; we 

consider more general sets K* given in (26) below. 

Let us summarize the major contributions of the present paper: 

1. For every integer > we define the Multidimensional Chebyshev 
spaces of order N as spaces of solutions of a special class of elliptic PDEs 
of order 2N. They generalize the classical one- dimensional Extended 
Complete Chebyshev systems (E'CT-sy stems). 

2. For every integer > we generalize the A^— dimensional subspaces 
Xn in C^~^ (/) (for intervals / C R) to a multidimensional setting. 
The generalization is a piecewise Multidimensional Chebyshev 
space of order N, and is said to have " Harmonic Dimension N" . This 
represents a new hierarchy of infinite-dimensional spaces of functions 
defined in domains in M". 

3. For every integer A'" > we define Hcirmonic Widths which generalize 
the Kolmogorov widths, whereby we use as approximants the spaces 
Ajv instead of finite-dimensional spaces used by the Kolmogorov 
widths. We generalize the one-dimensional Kolomogorov's results in 
the theory of widths. 

The crux of the new notion of hierarchy of infinite-dimensional spaces is 
the following: Let the domain D C be compact with sufficiently smooth 
boundary dD. Then the A?"— dimensional subspaces in C°° (I) will be gener- 
alized by spaces of solutions of elliptic equations (and by more general spaces 
introduced in Definition 14 below): 

Xn = {u: P2NU (x) = 0, for x e D} d L2 (D) ; (3) 
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here P2N is an elliptic operator of order 2A'" in the domain D. Respectively, 
the simplest version of our generalization of Kolmogorov's theorem about 
widths finds the extremizer of the following problem 

infdist(A'^,ir;) , 

where K* is the set defined in (2) and is defined in (3) by an eUiptic 
operator P2N of order 2N\ for the complete formulation see Theorem 23 
below. 

What is the reason to take namely solutions of elliptic equations in the 
multidimensional case is explained in the following section. 

Acknowledgements: The author acknowledges the support of the 
Alexander von Humboldt Foundation, and of Project DO-02-275 with Bul- 
garian NSF. The author thanks the following Professors: Matthias Lesch 
for the interesting discussion about hierarchies of infinite-dimensional linear 
spaces, Hermann Render about advice on multivariate polynomial division, 
and Peter Popivanov, Nikolay Kutev and Georgi Boyadzhiev about advice 
on Elliptic BVP. 



2 Multidimensional Chebyshev spaces and a 
hierarchy of infinite-dimensional spaces 

Let us give a heuristic outline of the main idea of this new hierarchy of 
spaces, by explaining how it appears as a natural generalization of the finite- 
dimensional subspaces of C^~^ [a, h] in a compact interval [a, 6] in R. First 
of all, we will show that there exists an amazing relation between the finite- 
dimensional subspaces of C^~^ [a, h] and the theory of Chebyshev systems. 

Let us construct some special type of A— dimensional subspaces of C^~^ ( J)| 
where the interval J = (c, d) C M. Let the functions pj, j = 1, 2, A satisfy 
Pj > on J, and pj G C'^~^^~^ (J) . We assume that the functions pj satisfy 
the necessary integr ability so that we may define the following functions: 

vi it) = Pi it) (4) 

V2 (t) = pi (t) I P2 {t2) dt2 (5) 
J c 

rt rti rtN-i 

Vn (t) = pi (t) / p2 (^2) / p3 (ts) ■ ■ ■ Pn (tN) dt2dts ■ ■ - dtN- (6) 

Jc J c J c 
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Let us recall some classical results about the space Xj^ — span {f j}^^ . 
For every k = 1,2, ...,N the consecutive Wronskians for the system of func- 
tions {vj}^^i may be computed explicitly and are given by 



Wk := W (wi, V2, ...,Vk) = p\pl ■■■Pk, (7) 



and vice versa: 



p^ = Wi = v^, p2 = W2/Wl (8) 
Pk = WuW„.2/Wl_, for > 3, (9) 

(cf. [38], or [20], chapter 11, formulas 1.12 and 1.13). From representation 
formula (7) directly follows that for all A; = 1, 2, A*" the Wronskians satisfy 

W{v^,V2,...,Vk)>Q on J. (10) 
Let us define on J the ordinary differential operator 

^\'di) ~ ItpNit) ' ' ' dip2{t)dipi (i)' ^ ' 

Then, from formulas (4)-(6) directly follows that all v/s, hence all elements 
of the space spa.n{vj}^^^ , satisfy the ODE 

Lnu (t) = 0, for t e J. (12) 

Obviously, the operator L^r has a non-negative leading coefficient and is in 
this sense one-dimensional "elliptic". 

We have the following classical result (cf. [20], chapter 11, Theorem 1.2). 



Proposition 1 The space 



Xn = span{vj}^^ (13) 



iN-l 



is an N— dimensional subspace of C (J) . 

We recall the following definition (cf. [20], chapter 11). 

Definition 2 A space X^ C C^~^ (J) is called ECT-space (or Extended 
Complete Chebyshev space) if it has a basis {vj}J^i satisfying the Wron- 
skian condition (10). 
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Our terminology above differs slightly from the accepted terminology: we 
consider Chebyshev systems on open intervals J and instead of" £^CT-system"| 

we say "i^CT-space". 

The following result characterizes the typical ("general position") A'^— dimensional| 
subspaces of C^~^ [a, h] by means of the E'CT-spaces. 

Theorem 3 "Almost all" N — dimensional subspaces ofC^~^ [a, b] are finite- 

piecewise ECT- spaces in the following sense: If Xj^ is an N — dimensional 
subspace of C^~^ [a, 6] then there exists a sequence of N— dimensional sub- 
spaces of C^~^ [a, 6] , m > 1, satisfying: 

1. For every space X^ there exists a finite subdivision a < to < ti < 
■ ■ ■ < tp^ = b of the interval [a, b] such that the restriction of X^} to every 
subinterval {tj,tj^i) is an ECT-space. 

2. The following limit holds in the metric of C^~^ [a, b] , 

U {X]^) U (Xj,) for m ^ oo, 

where U denotes the unit ball in the corresponding space. 

The proof and an example are provided in the Appendix in Section 10.1 
below. 

Hence, from Theorem 3 and formula (12) we see that a typical A^— dimen- 
sional subspace of C^~^ [a, b] is a piecewise i^CT-space, i.e. piecewise solu- 
tion space of a family of ordinary differential operators Ljv (with coefficients 
depending on the intervals {tj,tj+i) ). In our multidimensional generaliza- 
tion we will generalize these typical A^— dimensional subspaces of C^^^ [a, b] . 
Indeed, Theorem 3 already suggests an Ansatz for Multidimensional 
Chebyshev spaces which generalize the one- dimensional i^CT-spaces: 
First, we generalize the one-dimensional operators Ljv in (11) by considering 
in a domain D (ZW^ elliptic partial differential operators of the form 

P2iv(a;,i5.) = g«g(^)---g(^) 

where Q^^^ are elliptic operators of second order in D. Then the corresponding 
solution space Ajv defined by 

Xn := {u e C°° (D) : P2NU (x) = in D} , (14) 

is our generalization of the one-dimensional ^CT-space, and we call it Mul- 
tidimensional Chebyshev space. 

However, we need to impose some more conditions on the elliptic oper- 
ators (5*^^^ : We would hke that the elements of the space generahze the 
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interpolation properties of the one-dimensional ECTspeices Xj^, and this 
would require more conditions to be imposed on the operators Q^^\ Com- 
plete analogy between the one-dimensional and the multidimensional case is 
achieved only for the onc-dimcnsional i^CT-spaces of even dimension which 
satisfy the following interpolation property ([20], chapter 11): 

Proposition 4 Let the ECT-space X2M C C^m-i ^j-^ given. Then for 
every suhinterval Ii = [ai,bi] C /, and for arbitrary constants {ck,dk}^SQ^ , 
the (Dirichlet) boundary value problem 

xiW(ai) = Cfc /orA; = 0,l,...,M-l (15) 
xiW(6i) = 4 /or A; = 0,1,.. .,M- 1 (16) 

has a solution u e X2m- 

The interpolation property of Proposition 4 reminds us immediately of 
the solvability of the Elliptic BVP. We specify below the well-known Dirichlet 
EVP for the operator P2N considered on subdomains Di G D: 

P2NU (x) = for a; e Di (17) 

)k 
u{y)^Ck{y) ioryedDi, for A; = 0, 1, iV - 1. (18) 

Thus the solvability of the one- dimensional problem (15)-(16) in the space 
X2M may be considered as a special case of the multidimensional theory for 
Elliptic Boundary Value Problems (BVP). 

Let us remind that the Dirichlet BVP in (17)-(18) is well-known to be 
solvable for data {c^ {y)}^^Q from a proper Sobolev or Holder space on the 
boundary dDi. An important point is that for a large class of elliptic op- 
erators P2N every solution of (17)-(18) may be approximated by solutions 
in the whole domain D, i.e. by elements of Ajv. This may be considered as 
a substitute of the interpolation property (15)-(16) in the one-dimensional 
case. This is also the explanation for the judicious choice of the special class 
of operators P2N in Definition 14 below, as we mimic the operators in (11) 
by satisfying some natural interpolation properties. 

Making analogy with the one-dimensional case (15)-(16), we may say 
that here the space Xn defined in (14) is "parametrized" by the boundary 
conditions BjU, however the "parameters" {c^ (l/)}flo^ run a function space. 
Hence, the spaces A'^v may be considered as a natural generalization of the 
one- dimensional i^CT-spaces and for that reason we call them Multidimen- 
sional Chebyshev spaces. 
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After having defined the Multidimensional Chebyshev spaces, the next 
step will be to introduce the promised multidimensional generalization of 
the "typical" A^— dimensional subspaces of (/) . We will define them 

in Definition 14 below as subspaces of functions in L2 (D) which are 
piecewise solutions of (regular) elliptic differential operators P2N of order 
2N. We will say that has "Harmonic Dimension N" and we will write 

hdim (Xn) = N 

Kolmogorov's notion of A^— width (and in a similar way Gclfand's width) 
is naturally generalized for symmetric sets by the notion of "Harmonic 
A^— width" defined by putting 

hdjv (-S") := inf dist (Xf^, S) , 

hdim(Xjv)=iV 

see Definition 22 below. The main result of the present paper is the com- 
putation of 

hd;v (K;) for N<p, 
where K* is defined in (2) and more generally in (26). 



3 Plan of the paper 

To facilitate the reader, in section 4 we provide a short summary of the 
original Kolmogorov's results. For the same reason, in section 5 we provide 
a short reminder on Elliptic BVP. In section 6 we prove the representation 
of the "cylindrical ellipsoid" set K* in principal axes which generalizes the 
one-dimensional representation of Kolmogorov, cf. Theorem 12 below. In 
section 7 we introduce the notion of Harmonic Dimension, and the First 
Kind spaces of Harmonic Dimension A^. Based on it we define Harmonic 
Widths which generalize Kolmogorov's widths. In section 8, in Theorem 23 
we prove a genuine analog to Kolmogorov's theorem about widths. It says 
that among all spaces X^ having Harmonic Dimension A^, some special space 
Xn provides the best approximation to the set K* in problem 

infdist(Xjv,A:;) , 

and this space Xf^ is identified by the principal axes representation provided 
by Theorem 12. In section 9 we introduce Second Kind spaces of Harmonic 
Dimension A^ and formulate a further generalization of Theorem 23. Ap- 
parently, the First and Second Kind spaces having Harmonic Dimension A^ 
provide the maximal generalization in the present framework. 
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A special case of the present results is available in [28], and might be 
instructive for the reader to start with. 

A final remark to our generalization is in order. In our consideration we 
will not strive to achieve a maximal generality. As it is clear, especially in the 
applications to the theory of widths even in the one-dimensional case we may 
consider not all A^— dimensional subspaces but "almost all" A"— dimensional 
subspaces of C°° (D) in some sense, or a class of A^— dimensional subspaces 
which are dense (in a proper topology) in the set of all other A^— dimensional 
subspaces. This "genericity" point of view is essential in our multivariate 
generalization since it will allow us to avoid burdensome proofs necessary in 
the case of the bigger generality of the construction. For the same reason 
we will not consider elliptic pseudo-differential operators although almost all 
results have a generalization for such setting. 

4 Kolmogorov's results - a reminder 

In order to make our multivariate generalization transparent we will recall 
the original results of Kolmogorov provided in his seminal paper [21]. Kol- 
mogorov has considered the set Kp defined in (1). He proved that this is an 
ellipsoid by constructing exphcitly its principal axes. Namely, he considered 
the eigenvalue problem 

(-1)^ ^i(2p) (^) ^ Xu (t) for t e (0, 1) (19) 

^(p+j) (0) = (1) = for J =0,l,...,p-l. (20) 

Kolmogorov used the following properties of problem (19)- (20) (cf. [31], 
Chapter 9.6, Theorem 9, p. 146, or [35], [36]): 

Proposition 5 Problem (19)-(20) has a countable set of non-negative real 

eigenvalues with finite multiplicity. If we denote them by \j in a monotone 
order, they satisfy \j — > oo forj — > oo. They satisfy the following asymp- 
totic Xj = TT^^j^^ {1 + O . The corresponding orthonormalized eig en- 
functions form a complete orthonormal system in L2 ([0, 1]) . The 
eigenvalue A = has multiplicity p and the corresponding eigenfunctions 
{^jY=i '^'^^ basis for the solutions to equation u^^ {t) = m the interval 

(0,1)7 

Further, Kolmogorov provided a description of the axes of the "cyhndrical 
ellipsoid" Ap, from which an approximation theorem of Jackson type easily 
follows (cf. [31], chapter 4 and chapter 5). 
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Proposition 6 Let / G L2 {[a, b]) have the L2— expansion 



f it) = J2f^i^^ ■ 



Then f G Kp if and only if 



For N > p + 1 and every f E Kp holds the following estimate ( Jackson type 
approximation ) : 



N 



< 



L2 



o 



N+l 



{N + iy 



(21) 



However, Kolmogorov didn't stop at this point but asked further, whether 



the hnear space :— {^/'jj^j^ provides the "best possible approximation 
among the hnear spaces of dimension N" in the foUowing sense: If we put 



djv (Kp) := inf dist {X^, Kp) 
the main result he proved in [21] says 

djv (Kp) = dist (Xn, Kp^ . 
Here we have used the notations, to be used also further, 

dist {X, Kp) :— sup dist {X, y) 

y&Kp 

dist (X, y) = inf \\x — y\\ . 

Hence, by inequality (21), equality (23) reads as 

1 



(22) 

(23) 

(24) 
(25) 



dN (Kp) = 



for AT > p 



•\/Ajv+i 

dN{Kp)^ 00 for AT^O, l,...,p-l. 

Definition 7 The left quantity in (22) is called Kolmogorov N— width, 
while the best approximation space Xjy is called extremal (optimal) sub- 
space (cf. this terminology in [40J, [31], [36]). 
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Thus the main approach to the successful application of the theory of 
widths is based on a Jackson type theorem by which a special space 
is identified. Then one has to find, among which subspaces Xn is Xn the 
extremal subspace. Put in a different perspective : one has to find as wide 
class of spaces X^ as possible, among which X^ is the extremal subspace. 

Now let us consider the following set which is a natural multivariate gen- 
eralization of the above set Kp defined in (1): For a bounded domain B in 

we put (more generally than (2)) 

K; := |m e (B) : J \L2pU {x)f dx < 1^, (26) 

where is a strongly elliptic operator in B. Let us remark that the Sobolev 
space H"^^ (B) is the multivariate version of the space of absolutely continuous 
functions on the interval with a highest derivative in L2 (as in (1)). An 
important feature of the set K* is that it contains an infinite- dimensional 
subspace 

{u e H'^P (B) : L2pU {x) = 0, for x e B} . 
Hence, all Kolmogorov widths are equal to infinity, i.e. 

dj^ [K*p) =00 for iV > (27) 

and no way is seen to improve this if one remains within the finite-dimensio- 
nal setting. 

The main purpose of the present paper is to find a proper setting in the 
framework of the Polyharmonic Paradigm which generalizes the above results 
of Kolmogorov. 

5 A reminder on Elliptic Boundary Value 
Problems 

Let us specify the properties of the domains and the elliptic operators which 
we will consider. In what follows we assume that the domain D, the differ- 
ential operators and the boundary operators satisfy conditions for regulcir 
Elliptic BVP. Namely, we give the following: 

Definition 8 We will say that the system of operators 

{A]Bj, j = l,2,...,m} 

forms a regular Elliptic B VP in the domain D c M."- if the following 
conditions hold: 
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1. The operator 

\a\,\P\<m 

is a differential operator with a principal part defined as 

\a\+\l3\=2m 

It is uniformly strongly elliptic, i.e. for every x E D holds 

Co\^f"'<\Aoix,0\<Ci\^f"' for all real ^eW'MO} . 

2. The domain D is bounded and has a boundary dD of the class C^™. 

3. For every pair of linearly independent real vectors ^, rj and x E D the 
polynomial in z, Aq {x, ^ + zrj) has exactly m roots with positive imaginary 
parts. 

4- The coefficients of A are in C°° [D) . The boundary operators Bj {x, D) =| 
bj^a{x)D°' form a normal system, i.e. their principal symbols are 

\a\<mj 

non- characteristic, i.e. satisfy Bj^ (x,^) = ^ bj^a {x) 7^ for every 

\a\=mj 

X e dD and ^ ^ 0, ^ is normal to dD at x; they have pairwise different 
orders nij which satisfy ruj < 2m for 1 < j < m, and their coefficients bj^a 
belong to in dD. 

5. At any point x G dD let v denote the outward normal to dD at 
X and let ^ ^ Q be a real vector in the tangent hyperplane to dD at x. The 
polynomials in z given by Bj^ {x,$, + zv) are linearly independent modulo the 
polynomial HfeLi ~ (0) where z'^ (^) denote the roots of Aq (x, ^ + zr]) 
with positive imaginary parts. 

Remark 9 With minor differences the above definition is available in [30] 
(conditions (i)-(iii) in chapter 2, section 5.1); in [39] (sections 5.11 and 5.12); 
in [19] (chapter 20 in [22] (section 23.2, p. A73). 

Let us define a special system of boundary operators called Dirichlet. We 

put 




for j = 1,2, 1 
for j = 1,2, - 1. 



13 



Obviously, 

ord (Bj) = j - 1, ord (Sj) ^p + j-1. 

Let us denote by the operator formally adjoint to the elliptic operator 
L2p. There exist boundary operators Cj, Tj, for j = 1,2, ...,p — 1, such that 

ord (Tj) = 2p - j, ord (C,) ^p-j 

and the following Green's formula holds: 

/ (L2pM ■ V — u ■ L^pv) dx = 2_, / i^j"^ ' ^j"^ ~ Bj'^ ' Tjv) day] (28) 

Jb j=0'^9B 

here 9„ denotes the normal derivative to dB, for functions u and v in the 
classes of Sobolev, u,v e H^p (B) (cf. [30], Theorem 2.1 in section 2.2, 
chapter 2, and Remark 2.2 in section 2.3). 

For us the following eigenvalue problem will be important to consider for 
U G H"^^ (B) , which is analogous to problem (19)-(20): 

LlpL2pU {x) = XU (x) iorxeB (29) 

BjL2pU{y)^SjL2pU{y)^0, ior y e dB, j = 0, 1, - 1 (30) 

where 9„ denotes the normal derivative at y e dB. It is obvious that the 
operator L2p-^2p is formally self-adjoint, however the BVP (29)-(30) is not a 
nice one. Since a direct reference seems not to be available, we provide its 
consideration in the following theorem which is an analog to Proposition 5. 

Theorem 10 Let the operator L2p be uniformly strongly elliptic in the do- 
main B. Then problem (29)- (30) has only real non-negative eigenvalues. 

1. The eigenvalue A = has infinite multiplicity with corresponding eigen- 
functions {^'j] which represent an orthonormal basis of the space of all 
solutions to the equation L2pU (x) — 0, for x & B. 

2. The positive eigenvalues are countably many and each has finite mul- 
tiplicity, and if we denote them by Xj ordered increasingly, they satisfy 
Xj — y oo for j — > oo. 

3. The orthonormalized eigenf unctions, corresponding to eigenvalues Xj > 
0, will be denoted by ■ The set of functions {V'jIjliU form 
a complete orthonormal system in L2 (B) . 

Remark 11 Problem (29)-(30) is well known to be a non-regular elliptic 
BVP, as well as non-coercive variational, cf. [1] ( p. 150 ) and [30] (Remark 
9.8 in chapter 2, section 9.6, and section 9.8 ). 

The proof is provided in the Appendix below, section 11.1. 
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6 The principal axes of the eUipsoid K* and 
a Jackson type theorem 

Here we will find the principal exes of the eUipsoid K* defined as 




where L2p is a uniformly strongly elliptic operator in B. 

We prove the following theorem which generalizes Kolmogorov's one- 
dimensional result from Proposition 6, about the representation of the el- 
lipsoid Kp in principal axes. 

Theorem 12 Let f e K*. Then f is represented in a L2— series as 

00 00 

i=i i=i 

where by Theorem 10 the eigenfunctions ip'- satisfy A^^ip'j (x) = while the 
eigenf unctions ipj correspond to the eigenvalues Xj > 0, and also 

00 

E^^/' ^ 1- (32) 

00 00 

Vice versa, every sequence {/j}"!^ U {/ilji '^ith ^ + ^ < 00 

j=i j=i 

00 

and ^^Xjfj < 1 defines a function / G L2 which is in K*. 

Proof. (1) According to Theorem 10, we know that arbitrary f E L2 (B) is 
represented as 

00 00 

/ (^) = E/i^^- (^) + E/^-^^- (^) 
3=1 3=1 

00 00 

ii/iii=Ei/ir+i:i/.p<~ 

3=1 j=i 

with convergence in the space L2 (i^) . 
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(2) Prom the proof of Theorem 10, we know that if we put 

(f)j {x) = L2p^pj {x) for j > 1, 
then the system of functions 

^ for,>l 

is orthonormal sequence which is complete in L2 (B) . 

(3) We will prove now that if / G L2 (B) then f e K* iS 

00 
3=1 

Indeed, for every / G H^^ (B) we have the expansion / (x) = '^^fj'ip'j {x) + 

3=1 

00 

''^^fjipj {x) . We want to see that it is possible to differentiate termwise this 
3=1 

expansion, i.e. 

00 00 
L2pf {x) = J^fjL^p^j {x) - ^2^^"^^ 

3=1 3=1 

Since < > is a complete orthonormal basis of L2 (-B) it is sufficient to 

I V J j>i 
see that 

J L2pf {x) 4>jdx = J ^^/,-f'2pV'j {x)^ 4>jdx. 

Due to the boundary properties of ipj and since 4>j = L2pipj, we obtain 

/ L2pf (x) (f)jdx = / / (x) L2p(f)jdx = \j / fi)jdx = Xjfj. 
Jb Jb Jb 



On the other hand 



J (^^Mk {x)j (pjdx = Xjfj. 



Hence 

(P3 i^) 



L2pf (x) = ^/jLapVj {x) = ^fj<Pj (x) = ^^J%fi 



j=i j=i j=i y^3 
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and since < > is an orthonormal system, it follows 

oo 

II will - Y.^^fl 

oo 

Thus iifeKp it follows that J^^^^J - ^■ 



oo oo 

|2 



Now, assume vice versa, that ^^ff^j < 1 holds together with + 

j=i j=i 

oo 

< oo. We have to see that the function 

oo oo 

belongs to the space H'^^ (B) . Based on the completeness and orthonormality 
of the system < ^^4i^ > we may define the function e L2 by putting 



00 



i=i V^j j=i 

it obviously satisfies WgW^^ < 1- 

Prom the local solvability of elliptic equations ([30]) there exists a function 
F e H'^P (B) which is a solution to equation L2pF — g. Let its representation 
be 

00 00 

with some coefficients Fj satisfying \Fjf < 00. As above we obtain 

j 

Xj / Fijjjdx = / FL2pL2pijjjdx = / L2pF ■ L2pifjjdx 
Jb Jb Jb 

g ■ (pjdx 

which implies Fj = fj. Hence, F — f and / e H^^ {B) . This ends the proof. 
■ 

We are able to prove finally a Jackson type result as in Proposition 6. 



B 
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Theorem 13 Let N > 1. Then for every N > 1 and every f E K* holds the 
following estimate: 



N 



< 



Li 



N+1 



Proof. The proof follows directly. Indeed, due to the monotonicity of Xj, 
and inequality (32), we obtain 



N 



X] 



oo ^ oo ^ 

L2 ^=^+1 



This ends the proof. 



7 Introducing the Hierarchy and Harmonic 
Widths 

In the present section we introduce the simplest representatives of the class 
of domains having Harmonic Dimension N, which are called First Kind 
domains. They are piece- wise solutions to regular elliptic equations. 

Definition 14 Let D <Z he a hounded domain. For an integer M > 1 
we say that the linear suhspace Xm C L2 (D) is of First Kind and has 
Harmonic Dimension M, and write 

hdim (Xm) = M, (33) 

if the following conditions are fulfilled: 

1. There exists a finite number of domains Dj with piece-wise smooth 
boundaries dDj (which guarantees the validity of Green's formula (28)), 
which are pairwise disjoint, i.e. Dif]Dj = for i 7^ j, and such that we 
have the domain partition 

D = \Jd,. (34) 

j 

2. We assume that for j = 1,2, ...,M the factorization operators 
Qj — Qj {x, Dj.) are second order uniformly strongly elliptic which 
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satisfy the maximum principle in the domain D, and the functions pj defined 
in D are infinitely smooth and satisfy 



M 



Z := IJ {x e L> : pfe (x) = 0} C U dDj \ dD. 

k=l j 

Define the operator 

P2M {x, D^) u {x) = Qm—Qm-1— Qi—u {x) (35) 

Pm Pm-1 Pi 

for the points x E D where it is correctly defined (out of the set Z ). 

We specify the interface conditions: Let us denote by ui = u\Di the restric- 
tion of u to Di. If for some indexes i 7^ j, the intersection H :— dDif]dDj 
has nonempty interior in the relative topology of dD^ (hence also in dDj) 
then the following interface conditions hold on H in the sense of traces: 

^\ Ui{x)=[-^\ Uj{x) /orA; = 0,l,...,2M-l; (36) 

here the vector denotes one of the normals at x to the surface dDif]dDj. 
We define the space Xm by putting 

Xm = 1 ^ ^ ^'"^ • ^2Mt^ (x) = 0, for X e U •=! D„ 1 
\ and u satisfies the interface conditions (36) j 

Definition 15 In the case of trivial partition (34), i-e. D — Di where we 
have functions pj free of zeros in D we call the space Xm Multidimensional 
Chebyshev space. 

Hence, by the above definitions, if Xm C L2 (D) is of First Kind and 
has Harmonic Dimension M, then its restrictions to every subdomain Dj is a 
Multidimensional Chebyshev space, i.e. Xm is a piecewise Multidimensional 
Chebyshev space. 

Remark 16 i. In [28] we considered the case of spaces Xm of Harmonic 
Dimension M defined by a single elliptic operator P2M (i-e. P2M — Qi) cind 
a trivial partition of D, i.e. D = Di. 

2. Let us comment on the interface conditions (36) in Definition 14- 
Let us assume that we have an elliptic operator P2M with smooth coefficients 
defined on D and that a non-trivial partition IJ Dj is given. Due to the piece- 
wise smoothness of the boundaries dDj we may apply the Green formula, and 
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from the interface conditions (36) it follows that "analytic continuation" is 
possible, hence every function in Xm is a solution to P^mu = in the whole 
domain D (see similar result in [22], Lemma 20.10, and the proof of Theorem 

20. ii;. 

3. One may choose a different set of interface conditions which are equiv- 
alent to (36), see [22] (Remark 2^.12), and [30] (Lemma 2.1 in chapter 2). 

4- The spaces Xm defined in Definition 14 mimic in a natural way the 
one- dimensional case: the operator P2M (35) is similar to the operator (11) 

in Proposition 3. 

5. The operator {jXj Pj^ X-P2M does not have a singularity in the principal 
symbol but possibly only in the lower order coefficients. 

Here is a simple non-trivial example to Definition 14: 

Di = {x : \x\ < 1} , D2 = {x :!< \x\ < 2} 
D = {x:\x\< 2} 

P4 {x; Dr,) u {x) = A ^ Am {x) for x e Di 

P| {x; D^) u (x) = -A ^ Au (x) for x e D2, 

where A is the Laplace operator. Typical elements of X2 are the functions 
u which are obtained as solutions to 

Au = (1 — |a;|) w in D, 

where Aw = in D. 

The following result shows that we may construct a lot of solutions be- 
longing to the set Xm of Definition 14. We call these "direct solutions". 

Proposition 17 Let us define the boundary conditions B^, k — 1,2, ...,M, 
on dD, by putting 

Biu — — u 
Pi 

BkU = —Qk-iBk-i for k>2. 
Pk 

Then the EVP 

P2MU {x) = forx eD (38) 

Bku{y)^hk{y) foryedD, and k ^ 1,2, M (39) 
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is solvable for arbitrary data {hk}^^-^ from the corresponding Sobolev spaces, 
i.e. hk e }j'2M-ord{Bk)-i/2 (^Q£)'j ^ Q^id the solution has the maximal regularity, 
i.e. ueH^^{D). 

Proof. For every j with 1 < j < M we consider the eUiptic BVP of Dirichlet 

QjW = / onD (40) 

w^h on dD. (41) 

By the assumptions on the operators Qj it is unique (by the maximum prin- 
ciple) and we will denote it by Ij {f,h). It is easy to see that the solution to 
P2MU {x) = is obtained inductively as 

u = pih (■ ■ -Pm-Jm-i {pmIm (0; Km) ; /^m-i) ■ ■■) , (42) 

where hj are arbitrary boundary data. 

For simplicity of notation let us assume that k = 2, i.e. P = Qi-^Q2-^- 
Then the boundary conditions satisfied by u are obtained from 

Q2W = on D 
B2W — /i2 on dD, 



and 



Hence, we obtain 



Qi ( —u] = P2W on D 
\Pi J 

Bi — u — hi on dD. 

Pi 



B2 i^jQi i^ju ]]=h2. 



Thus we see that the system of boundary operators on dD is 
Biu = — u, B2U — — Qi ( — u 

Pi P2 \Pl 

and satisfies the conditions of Definition 8, for normal system of boundary 
operators. We may proceed inductively to prove the statement for arbitrary 
A; > 3. 
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Remcirk 18 1. Formula (42) for representing the solution of P2mu{x) — 
in Proposition 17 coincides with the solution in formulas (4)-(6) in the one- 
dimensional case. 

2. One may prove that the set of "direct solutions" obtained in Proposition 
17 is dense in the whole space Xm defined in Definition 14, but we will not 
need this fact. 

The following fundamental theorem shows that, as in the one-dimensional 
case, on arbitrary small sub-domain G in D with G H (U ^^j) — ^i space 
Xm with hdim {Xm) — M has the same Harmonic Dimension M. Prom a 
different point of view, it shows that a theorem of Runge-Lax-Malgrange 
type is true also for elliptic operators with singular coefficients of the type of 
operators P2M considered in Definition 14. 

Theorem 19 Let the First Kind space Xm satisfy Definition I4 with 

hdim {Xm) = M. 

Assume that the elliptic operator P2M which corresponds to the space Xm has 
factorization operators Qj (from (35)) satisfying condition {U)^ for unique- 
ness in the Cauchy problem in the small.^ Let G be a compact subdomain in 
some Dj, i.e. Gf] (|J dDj) = 0. Then the set of "direct solutions" considered 
in Proposition 17 is dense in L2 {G) in the space 

{u e H^^ {G) : P2MU = inG}. 

Proof. For simplicity of notations we assume that for the elliptic operator 
P2M associated with Xm, by Definition 14, we have only two factorizing 
operators Qi and Q2, i.e. P2MU = Q2^Qi (^^) • 

Let us take a solution u e H'^^ {G) to P2MU = in G. We use the solution 
of formula (42) 

u = pih {p2h (0; /i2) ; ^1) , 

where the boundary data hi and /i2 are arbitrary in proper Sobolev spaces. 
By the approximation theorem of Runge-Lax-Malgrange type (cf. [6], Theo- 
rem 4, and references there), which uses essentially property {U)^ of operator 

^The differential operator P satisfies condition [U)^ for uniqueness in the Cauchy prob- 
lem in the small in G provided that if Gi is a connected open subset of G and u G (Gi) 
is a solution to P*u = and u is zero on a non-emplty subset of Gi then u is identically 
zero. Elliptic operators with analytic coefficients satisfy this property (cf. [4], part II, 
chapter 1.4; [6], p. 402). 
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Q2, we obtain a function which is a solution to Q2WS = in D and such 
that 

||/2(0;/i2) -t^e II L2(G) < 

Next wc apply the same approximation argument but with non-zero right- 
hand side P2I2 (0; /i2) (cf. [7]) to prove the existence of a function such 
that 

\\h{p2h{0;h2);hi) -VeW < Ce 

for some constant C > 0, where the constant C depends on the functions pj. 
Thus we obtain the function 

which satisfies 

ll^£ - '^\\l2{G) < Cl^' 

and is a "direct solution" in the sense of Proposition 17. 
■ 

The following theorem studies the orthogonal complement Xjy Xm of 
two First Kind spaces where M < N. While we will not need the whole 
generahty of the result proved, the proof shows that Q Xm has at least 
hdim equal to N — M. 

Theorem 20 Let M < N and the First Kind spaces Xm, Xn satisfy Defi- 
nition 14 with 

hdim (Xm) = M, hdim (Xn) = N. 

Assume that the elliptic operator P2n-i which is associated with the space 
Xn, has (by (35)) factorization operators Qj satisfying condition {U)^ for 
uniqueness in the Cauchy problem in the small (as in Theorem 19). Then 
the space Y = Xjq \ Xm is infinite- dimensional. 

Proof. (1) Let, by Definition 14, the partition (J-Dj and the operator P2M 
correspond to Xm, while the partition (J D'^ and the operator Pgjv correspond 
to Xn. Assume that Di D[ ^ 0. Then we will choose a subdomain G which 
is compactly supported in Dif]D[. 

Further we will fix our attention to the subdomain G where both operators 
P2M and are uniformly strongly elliptic and will construct a subset of 
Xn Xm restricted to the domain G. Let us be more precise: If we denote 

by 

X^ := {u : H^^ (G) : P^^u = in G} (43) 

then wc will construct an infinite-dimensional subspace of X^ X^. 

(2) For the uniformly strongly elliptic operator P2M on the domain G 
we choose the Dirichlet system of boundary operators Bj = Q^j-i , for j > 
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1, which are iterates of the normal derivative ^ on the boundary dG. As 

already mentioned the system of operators |p2m; ^ :i = 0,l,...,M — l| 

on G forms a regular Elliptic B VP (this is the Dirichlet EUiptic B VP for the 
operator P2m) (cf. [30], Remark 1.3 in section 1.4, chapter 2). 



We complete the system {Bj}^^^ by the system of boundary operators 

Sj = Q^M-t+j for J = 1, 2, ... Af. Hence, the system composed {5^}^^ \J {5*^}^ J 
is a Dirichlet system of order 2M (cf. [30], Definition 2.1 and Theorem 2.1 in 
section 2.2, chapter 2). Further, by [30] (Theorem 2.1), there exists a unique 
Dirichlet system of order 2M of boundary operators {Cj,Tj}'^^^ which is 

uniquely determined as the adjoint to the system {Bj, Sj}^-^^ , and the Green 
formula (28) holds on the domain G. We will use this below. 

(3) In the domain G we consider the elliptic operator P2nP2M- ^ 
product of two strongly elliptic operators it is such again. By a standard 
construction cited above (cf. [30], Theorem 2.1, section 2.2, chapter 2), we 
may complete the Dirichlet system of operators {Bj,Sj}^^i with N — M 

boundary operators Rj = q^^m-i+j ; J — 1, 2, A?" — M. Again by the above 
cited theorem, the Dirichlet system of boundary operators 

covers the operator P2nP2M- Finally, we consider the solutions g e f/"2Ar+2M (^Q^^^ 
to the following EUiptic BVP: 

P2nP2m9{x) = Q forxeC (44) 

Bjg {y) = S,g (y) = for j = 0, 1, A^ - 1, for y e dG (45) 
Rj9 (y) = h, (y) for j = 1, 2, AT - M, for y e dG. (46) 

We may apply a classical result [30] (the existence Theorem 5.2 and The- 
orem 5.3 in chapter 2), to the solvability of problem (44)-(46) in the space 

(4) Let us check the properties of the function P2m9 where g satisfies 
(44)-(46). First of all, it is clear from (44) that P2V5' ^ where we have 
used the notation (43). 

By Green's formula (28), applied for the operator P2M and for u = g we 
obtain 

/ P2M9 ' "^dx — for all V with P2MV = 
Jg 

which imphes that the function P2m9 satisfies P2m9 -L (-^m defined as 
(43)). 
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By the general existence theorem for EUiptic BVP used aheady above (cf. 
[30], Theorem 5.3, the Fredholmness property), we know that a solution g 
to problem (44)-(46) exists for those boundary data {hj}^Si^ which satisfy 
only a finite number of linear conditions (cf. [30], conditions (5.18)); these 
are determined by the solutions to the homogeneous adjoint Elliptic BVP. 
Hence, it follows that the space Y^_j^ of the functions P2m9 where is a 
solution to (44)-(46) is infinite-dimensional. 

(5) Let us construct a subspace of Xn\Xm which is infinite-dimensional. 
We use the obvious inclusion Xm\g C X^, Xm\g C Xf^, where for a space 
of functions Y (Z L2 {B) the space Y\g consists of the restrictions of the 
elements of Y to the domain G. 

First of all, we find an orthonormal basis {vj}-y^ in the infinite-dimensio- 
nal space Y^_j^ (where the norm is |H|£,2(g) )> t)y the Gram-Schmidt or- 
thonormalization we obtain functions Qj such that Vj = P2M9j ^'^^ J ^ 1- 

Let us put Ej 
H^^ (D) with 



2J- 



and use the density Theorem 19 to choose Uj e 



1% '^jWliiG) — 



for j > 1. 



The orthogonality of Vj to X^ infers dist {uj\G, -^m) > 1 — £j in the L2 (G) 
norm. Hence, dist {uj, Xm) > 1 — £ j in the L2 {D) norm, hence Uj ^ Xm- 
Let us see that for every choice of the constants aj holds 



N-\ 



Indeed, by the triangle inequality for the norm |H|j;,2(g) follows 



N-l 



N-l 



Vn 



N-l N-l N-l 

j=i j=i j=i 



<£n + 



N-l 



N-l 



or 



N-l 

3=1 



N-l 
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Obviously 



1 - £iv + XI ( ^ - ^^J- ) < 1 - £iv + J] (|"jf - £j) 
j=i V / j=i 

and since the left-hand side always exceeds 1/4, this ends the proof that the 
system of functions {uj\G}j^^ is linearly independent. Hence, the system 
{'^j}j>i linearly independent in the whole domain D. 

As noted above Uj ^ Xm, hence span {uj}j^^ is the infinite-dimensional 
space we sought. The proof is finished. 
■ 

We have the following prototype of Theorem 20, proved in [28]. 

Corolleiry 21 Let M < N and Xm, Xn satisfy Definition 14 with 

hdim (Xm) = M, hdim (X^) = N. 

Assume that the differential operators P2M md P2JV) associated with Xm and 
Xn, have trivial factorization operators by the definition (35), and trivial 
domain partitions D — Di and D — D[ by (34)- Then the space of solutions 
of the Elliptic BVP (44)-(46) where G — D is a subspace of the space 

Y = Xn Q Xm- 

The proof may be derived from the proof of Theorem 20 where we have 
put G = D. Note that we do not need the {U)^ condition for the operator 
PliN- Hence, strictly speaking. Corollary 21 is not a special case of Theorem 
20. 

Now we provide a generalization of Kolmogorov's notion of width from 
formula (22); without restricting the generality we assume that we work only 
with symmetric subsets. 

Definition 22 Let A be a centrally symmetric subset in L2 {B) . For fixed 
integers M > 1 and N > we define the corresponding Harmonic Width 
by putting 

hdM,N (K) := ^inf dist (Xm0Fjv, A) , 

where mfxM,FN ^■^ taken over all spaces Xm, Pn C. C°° {B) with 

hdim (Xm) = M 
dim {Fn) = N. 
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8 Generalization of Kolmogorov's result about] 
widths 

Next we prove results which are analogs to the original Kolmogorov's results 
about widths in (23). 

We denote by a finite-dimensional subspace of L2 {B) of dimension 
N. We denote the special subspaces for an elliptic operator = I/2p by 

Xp := {u e H'^P (B) : L2pU (x) = 0, for x E B} , (47) 

and the special finite-dimensional subspaces 

:= {i,, : J < iV},„ (48) 

where ijjj are the eigenf unctions from Theorem 10. 

Theorem 23 Let K* be the set defined in (31) as 

K; := jii e (B) : J \L2pU (x)|' < l| , 

with a constant coejfi,cient operator L2p which is uniformly strongly elliptic 
in the domain B. Let Xm be a First Kind subspace of L2 (B) of Harmonic 
Dimension M, according to Definition I4, i.e. 

hdim {Xm) = M, 

and let N >0 be arbitrary. 

1. IfM<p then 

dist (Xm©Fjv, k;) = 00. 

Hence, 

ini dist {Xm^Fn, K;) = 00 

or equivalently, 

hdM,N {K*) = 00. 

2. IfM^p then 

inf dist (Xp0Fjv, k;) = dist (Xp^Fn, k;) , 

i.e. 

Mp,N (k;) = dist (x^eFjv, k;^ . 
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Remcirk 24 In both cases we see that the special spaces Xj^^^^Fj\f are ex- 
tremizers among the large class of spaces Xm^F^. 

Proof. 1. If we assume that Xm and Xp are transversal the proof is clear 
since Xp C K* and there will be an infinite-dimensional subspace in Xp C K* 
containing at least one infinite axis with direction f E Xp\ Xm, such that 

dist(XM0F^,/)>O 

which implies 

dist(XM0F;v,i^;) = 00. 

If they are not transversal we remind that operators with analytic coefficients 
satisfy the (C/)^ condition, and we may apply Lemma 25. 

2. For proving the second item, let us first note that Xp C Xp^F^. 
Indeed, since Xp C K* the violation of Xp C Xp0F/v would imply that 
there exists an infinite axis / in K* not contained in Xp0F/v which would 
immediately give 

dist {Xp^Fn,k;) = 00. 

Using the notations of Definition 14, there exists a finite cover [J Dj = B, and 
by Lemma 28 (applied for M = = p ) it follows that on every subdomain 
Dj holds P^p — (^) -^2p for some function Cj (x) . Thus we see that every 
u e Xp is a piecewise solution of L2pU — on B, satisfying the interface 
conditions (36) in Definition 14. Here we use an uniqueness theorem for 
"analytic continuation" across the boundary argument (proved directly by 
Green's formula (28) as in [22], Lemma 20.10 and the proof of Theorem 20.11, 
p. 422) that u e Xp, hence Xp — Xp. 

Further we follow the usual way as in [31] to see that Fn is extremal 
among all finite-dimensional spaces Fjv, i.e. 

inf dist (Xp0FA,,i^;) = dist (Xp^Fn,k;'^ . 

This ends the proof. 
■ 

We prove the following fundamental result which shows the mutual posi- 
tion of two subspaces: 

Lemma 25 Assume the conditions of Theorem 20. Let the integer Mi > 0. 
Then 

dist {Xm^Fm„Xn) = 00. 
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The proof follows directly from Theorem 20 since a finite-dimensional 
subspacc would not disturb the arguments there. 
We obtain immediately the following result. 

Corollary 26 Let us denote by Un+i the unit ball in X^v+i in the I/2 
norm. Then 

dist (X^, C/jv+i) = 1- 

Remark 27 Lemma 25 and especially the above Corollary may be considered 
as a generalization in our setting of a theorem of Gohberg-Krein of 1957 (cf. 
[31], Theorem 2 on p. 137 ) in a Hilbert space. 

We need the following intuitive result which is however not trivial. 

Lemma 28 Let for the strongly elliptic differential operators L^n — P2N {x] -D^:)! 

and P2M = P2M {x; D^) of orders respectively 2N < 2M in the domain B, 
the following inclusion hold 

Xr.CiH''' (B) cXm\F, 

or 

{u e H^^ (B) : L2NU (x) =0, xeB} C 
(l{ue H''^ (B) : P2MU (x) = 0, xeB}\F, 

where F G L2 (B) is a finite-dimensional subspace of L2 {B) . Then 

P2M {x, D^) = P2M-2N Dx) L2N {x, D^) (49) 

for some strongly elliptic differential operator P2M-2N of order 2M — 2N. 

Proof. It is clear that the arguments for proving equality (49) are purely 
local, and it suffices to consider only xo — 0, or we assume that the operator 
L2N has constant coefficients. 

First, we assume that the polynomial L2N (C) is irreducible. Then we 
consider the roots of the equation 

L2N (C) = for C e C". (50) 

If C is a solution to (50) then the function v (x) — exp x)) is a solution 
to equation L2NV = in the whole space. Hence 

P2MV = P2M {xq; D^) V {xo) = P2M {xo; C) v {xq) = 0, 
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and by a well-known result on division of polynomials in algebra [41] (The- 
orem 9.7, p. 26), the statement of the theorem follows. 

Now let us assume that L2N is reducible and decomposed in two irre- 
ducible factors L2N = Q2Q1, which may be equal. Obviously, both poly- 
nomials Qi and Q2 are uniformly strongly elliptic. Since the solutions to 
Qiu — are also solutions to L2N it follows by the above that 

P2M {x, D^) = P2M-2JV1 {x, D^) Qi {D^) 

where 2Ni is the order of the operator Qi- Further, following the standard 
arguments in [30], by the uniform strong ellipticity of the operator Qi, for 
every ^ G C", and for arbitrary s > 2Ni, there exists a solution u E H'^ (B) 
to equation 

QiUt^ (x) = e^'''^^ for x e B. 
Let C e C" be a solution to equation Q2 (C) = 0. Obviously, 

hence, by the above it follows 

P2M {X, D^) Uc^ = -P2M-2JV1 {^^ D^) Qi (D^) Ui; = -P2M-2JV1 i^: C) = 0. 

It follows that P2M-2N1 (^0; C) = 0. We proceed inductively if L2N has more 
than two irreducible factors. 



9 Second Kind spaces of Harmonic Dimen- 
sion N and widths 

In order to make things more transparent, in Definition 14 we avoided the 
maximal generality of the notions and considered only First Kind spaces of 
Harmonic Dimension A^. Let us explain by analogy with the one-dimensional 
case how do the " Second Kind" spaces of Harmonic Dimension N appear. 

In the one-dimensional case, if we have a finite-dimensional subspace 
Xn C (/) then for a point Xq e I the space 

Y -.^{ueXN-.u (xo) = 0} 

is an {N — 1) —dimensional subspace. We would like that our notion of 
Harmonic Dimension N behave in a similar way. For example, if Xj^ is 
defined as a set of solutions of an elliptic operator P2N by 

Xn := {u e H^^ (B) : P2NU = in B} 
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then it is natural to expect that the space 

Y ■={ueXN:u = on dB} 
has Harmonic Dimension A'^ — 1. A simple example is the space 
Y^{ueH^ (B) : A^-w = inB, u^O on dB} . 

On the other hand, it is Theorem 20 and Corollary 21 above which show 
that such Second Kind spaces of Harmonic Dimension A'^ appear in a natural 
way when we consider the space X^QXm based on solutions of EUiptic EVP 
(44)-(46). 

We give the following definition. 

Definition 29 For an integer M > 1 we say that the linear subspace Xm C 
L2 {D) is of Second Kind and has Harmonic Dimension M, and write 

hdim (Xm) = M, 

if it satisfies all conditions of Definition I4 however with an elliptic opera- 
tor P2N, with N > M and all elements u e Xm satisfy N — M boundary 
conditions 

BjU = on dD, j = 1, 2, N - M. 

Here the boundary operators {-Bj}^^ are a normal system of boundary 
operators defined on dD, by Definition 8, item 4)- 

By a technique similar to the already used we may prove the following 
results which generalize Theorem 23. We assume that K* is the set defined 
by (31) with a strongly elliptic constant coefficients operator L2p. The space 
Xp is defined by (47) and the space by (48). 

The following theorem is a generalization of item 1) in Theorem 23. 

Theorem 30 Let M < p and L > be arbitrary integer. Let Xm be a 
Second Kind space with Harmonic Dimension N, i.e. 

hdim (Xm) = M. 

Let Fl be an L— dimensional subset of L2 (B) . Then 

dist (Xm®Fl,k;) = ^. 

The proof of Theorem 30 follows with minor modifications of Lemma 25 
(Theorem 20). 

It is more non-trivial to consider the case N = p. First we must prove the 
following result. 
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Lemma 31 Let Xp be a Second Kind space of Harmonic Dimension p and 
L > be an arbitrary integer. Let Fl be an L— dimensional subset of L2 (B) . 
Then 

dist {Xp^Fl,K;) <oo 

implies ^ 

Xp C Xp. (51) 

Let the elliptic operator P2M (ind the boundary operators {Bj}^J^^ be associ- 
ated with Xp by Definition 29. Then (51) implies the following factorizations: 

Bj = B'jL2p for J = 1,2,..., M- p. 
The operator P2M-2P uniformly strongly elliptic in D, and the boundary 
operators {i?^ }^^^ form a normal system which covers the operator P2M-2p- 

Finally, the following generalization of item 2) in Theorem 23 may be 
proved. It shows that one needs to take into account the index of the Elliptic 
BVP involved. 

Theorem 32 Let us consider those spaces Xp of Second Kind with Harmonic 
Dimension p for which 

dist {Xp^Fl,k;)< 00 

with associated operators P2M o-nd boundary operators {Bj)^J^ . Following 

the notations of Lemma 31, let us denote by M the following space of solutions 
w e i/2M-2p ^1^^ Elliptic BVP on the domain D: 

-f2M-2p^ = onD 

B'-w = 0, on dD, for j = 1, 2, M -p 

Then the following equality holds 

inf {dist {Xp^Fl, K;) : dim (X) + L = L,} = dist (Xp^h^K;) . 

Prom the theory of EUiptic BVP is known that dim (M) < 00 (cf . [30] , 

Theorem 5.3, chapter 2, section 5.3). Let us denote by {w;^}^™*''^'' a basis of 
the space Af, and by Ug a fixed solution to L2pUs = Ws. The main point in 
the proof of Theorem 32 is that arbitrary solution u to equation P2MU = 
may be expressed as 

dim(A/') 

u = XgUg + V 

s=l 

where v is a. solution to L2pV = 0. 
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10 Appendix 



10.1 Proof of Theorem 3 

Follows the proof of Theorem 3: 

Proof. Let {vj}J^^ be a basis of the space Xn, i.e. — span {vj}^^-^ . 
Then by a Theorem in [16] there exists a sequence of algebraic polynomials 
) ^ ^ 1) such that in the norm of C^~^ (/) for j = 1,2, ...,N holds 

Pj" — > vj for m — >oo. (52) 

Since dimXjv = A?" it is clear that we may choose the polynomials {-P™}^^^ 

also linearly independent. Hence, we obtain the spaces X™ = span 

with dimX'^ = N. Since for the basis we have the limit (52) it follows that 

also for the unit balls holds U (X]^) — > U (Xj^) , for m — > oo. 

Let us fix m > 1. By a theorem of M. Bocher (cf. [5] and references 
therein) we know that the Wronskians of linear independent analytic func- 
tions are never identically zero. Since the Wronskians in (7) are given by 

W, (t) = W (Pf (t) , (t) Pf (t)) for k = l,2, N, 

they are polynomials, and since they cannot be identically zero it follows 
that they have a finite number of zeros. Hence, for fixed m > 1 we may 
subdivide the interval / into subintervals a < to < ti < ■ ■ ■ < tp^ = b, 
and on every subinterval {tj,tj+i) all Wronskians have a definite sign. By 
[20] (chapter 11, Theorem 1.1) it follows that on every interval {tj,tj+i) 
the polynomials {-Pj"}^^ constitute an ^^CT-system. Hence {-Pj"}^^ is a 
piecewise ^^CT-system. This ends the proof. 
■ 

Let us note that if {vj}^^-^ are polynomials, then by formula (8)- (9) the 
functions pj are rational functions on the whole interval [a, b] . We will provide 
an example to illustrate Theorem 3. 

Let N — 2. We consider the 2— dimensional space X2 — span {141,^2} C 

(/) where 

U2 (t) = 

and / = (—1, 1) ; here x (t) is the Heaviside function equal to for t < and 
to 1 for t > 0. Note that the Wronskian W {ui (t) ,U2 (t)) = on /. How- 
ever we may approximate the space X2 by the linear 2— dimensional spaces 
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X| = span {ui + £, 1*2} C (I) with e — > 0. The system {ui + £, 1^2} has 
a Wronskian W {ui (t) + e, U2 (t)) equal to 2te. For the last system the func- 
tions pI and p| satisfying equations (4)- (6) are given by 

pI (t) = ui (t) + e 

2* for t < 



11 Appendix 

11.1 Proof of Theorem 10 

Proof. (1) We consider the following auxiliary elliptic eigenvalue problem 

L2pL*2p(t) {x) = A0 {x) on B, (53) 

B^cl>{y)^S^(t>{y)^Q for j = 0, 1, - 1, for y e (54) 

Since this is the Dirichlet problem for the operator i^2p-^2p it is a classical 
fact that (53)- (54) is a regular Elliptic EVP considered in the Sobolev space 
H^^ (B) , as defined in Definition 8. Also, it is a classical fact that the 
Dirichlet problem is a self-adjoint problem (cf. [30], Remark 2.4 in section 
2.4 and Remark 2.6 in section 2.5, chapter 2). 

Hence, we may apply the main results about the Spectral theory of regular 
self-adjoint Elliptic EVP. We refer to [12] (section 3 in chapter 2, p. 122, 
Theorem 2.52) and to references therein. 

Ey the uniqueness Lemma 33 the eigenvalue problem (53)-(54) has only 
zero solution for A = 0. It has eigenfunctions 0^ G H'^^ (B) with eigenvalues 
Afe > for A; = 1, 2, 3, ... for which A^ — > 00 as /c — > 00. 

(2) Next, in the Sobolev space if^^ (B) , we consider the problem: 

L2pL*2pip (x) = 0fe (x) on B (55) 

Bjcp (y) = Sjcp (y) = for j = 0, 1, - 1, for y e dB. (56) 

Obviously, the Elhptic EVP defined by problem (55)- (56) coincides with 
the Elhptic EVP defined by (53)- (54) up to the right-hand sides, and all 
remarks there hold as well. Hence, problem (55)- (56) has unique solution 
cpk e H'^P {B) . We put 

i'k = L*2p(pk. 

Hence, L2pipk = 4>k- We infer that on the boundary dB hold the equalities 
BjL2pipk = Bj4>k and SjL2pil'k = Sj4>k', since (pk are solutions to (53)-(54) it 
follows 

BjL2p^JJk (y) = SjL2p^k (y) = for j = 0, 1, - 1, for y e dB. (57) 



34 



We will prove that are solutions to problem (29)- (30), they are mutu- 
ally orthogonal, and they are also orthogonal to the space {v e H'^^ : L2pV — 

(3) Let us see that 

L2pL2p1pk = >^ki>k- 
By the definition of ipk this is equivalent to 

L*2pL2pL*2p(pk = XkL^pipk', 
from L2pL2p(pk — (pk this is equivalent to 

Llp^Pk — XkL^pCpk 

On the other hand, by the basic properties of 4>k and ipk, we have obviously 
L2pL*2p(j)k = XkL2pL*2pipk, hence 

L2pL*2p {(f)k - \kVk) = 0. 

Note that both (f)k and ipk satisfy the same zero Dirichlet boundary conditions, 
namely (54) and (56). Hence, by the uniqueness Lemma 33 it follows that 
(f)k — \k^k — which implies LlpL2pipk — ^k'^Pk- Thus we see that ipk is a 
solution to problem (29)- (30) and does not satisfy L2pip = 0. 

(4) The orthogonality to the subspace {v G H^^ : L2pV = 0} follows easily 
from the Green formula (28) applied to the operator L2pL2p, 

/ {L*2pL2pil)k ■ V - L2pipk ■ L2pv) dx 
Jd 

= X! / {SjL2pipk ■ CjV - BjL2pi)k ■ Tjv) 
in which substitute the zero boundary conditions (57) of tpk-, and equality 

/ L*2pL2pilJk ■ vdx = Afc / Vfe • vdx. 
Jd Jd 

The orthonormality of the system follows now easily by the equal- 
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Afe J ipk'ipjdx = J L*2pL2pipk'4^3dx = J L2pipkL2pipjdx = J (f)k<l>jdx 
and the orthogonality of the system {(pkjkLi ■ 
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(5) For the completeness of the system {V'fc}^]^, let us assume that for 
some / e L2 (-B) holds 

/ / • iJkdx = / / • i^'kdx = for all k>l. (58) 
Jb Jb 

Then the Green formula (28) implies 

= Afc / / ■ iJkdx = f ■ L*2pL2pi'kdx = / Lgp/ ■ L2pipkdx 

JB JB JB 

— / L2pf ■ (t>kdx for all /c > 1. 

JB 

By the completeness of the system {<i)k}k>i ^^^^ implies that L2pf = 0. From 
the second orthogonality in (58) follows that / = 0, and this ends the proof 
of the completeness of the system {V'j}"^^ [_} ■ 
■ 

We have used above the following simple result. 
Lemma 33 The solution to problem (53)-(54) for X = is unique. 
Proof. From Green's formula (28) we obtain 

/ [L2p(f)f dx- (f)- L*2pL2p4>dx = V] / {Sj(f) ■ CjL2p4> - Bj(f) ■ TjL2p(f)) day, 

JB J j=iJdB 

hence L2p(f) = 0. 

Now for arbitrary v e H'^^ (B) by the same Green's formula we obtain 
/ (iv2p0 • V — (f) ■ L2pv) dx — / {Sj(j) • CjV — Bj(f) ■ Tjv) day — 0, 

JB JdB 



hence 

/ (f) ■ L^pVdx — 0. 
Jb 

From the local existence theorem for elliptic operators (cf. [30]) it follows 
that for arbitrary / € L2 (B) we may solve the elliptic equation L2pV = f 
with V e H^P {B) . From the density of H^p (B) in L2 {B) we infer = 0. 
This ends the proof. 
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12 Some open problems 

1. First of all, one has to study basic questions about the sets having 
Harmonic Dimension, by considering the sets XmCI^n, ^m^^n, 
Xm^Xjsi, and similar, and finding their Harmonic Dimension. 

2. One has to check that the maximal generality of the theory in the 
present paper will be achieved by considering elliptic pseudo-differential 
operators. 

3. New Jackson type theorems in approximation theory are suggested by 
the results proved: the simplest way to state them is to consider spaces 
defined for example by 

{u : \L2pU {x)\ < 1 for X G D} . 

In the case of polyharmonic operator Jackson type results have been 
proved in [23] . By the proof of Theorem 23 one may expect a Jackson 
type theorem to be proved for approximation by solutions of equations 
{u : P2NU = in D} , where the operator P2N is of the form P2N — 

4. One has to find a proper discrete version of the present research which 
will be essential for the applications to Compressed Sensing, compare 
the role of Gelfand's widths in [10], [9]. 

5. Let us recall that one-dimensional Chebyshev systems are important 
for the qualitative theory of ODEs, in particular for Sturmian type 
theorems, cf. e.g. [2], [3]. V.I. Arnold discusses the importance of the 
Chebyshev systems in his Toronto lectures, June 1997, Lecture 3: Topo- 
logical Problems in Wave Propagation Theory and Topological Econ- 
omy Principle in Algebraic Geometry. Fields Institute Communica- 
tions, available online at http://www.pdrrii.ras. ru/~arnsern/Arnold/arn-^ 
papers.html. On p. 8 he writes that "Even the Sturm theory is missing 
in higher dimensions. This is an interesting phenomenon. All attempts 
that I know to extend Sturm theory to higher dimensions failed. For 
instance, you can find such an attempt in the Courant-Hilbert's book, 
in chapter 6, but it is wrong. The topological theorems about ze- 
ros of linear combinations for higher dimensions, which are attributed 
there to Herman, are wrong even for the standard spherical Laplacian." 
The attempts to find a proper setting for multidimensional Chebyshev 
systems are present in the works of V.I. Arnold in the context of mul- 
tivariate Sturm type of theorems, see in particular problem 1996-5 in 



37 



[3]. In view of this circle of problems, one may try to apply the present 
framework and to obtain a proper Ansatz for multidimensional Sturm 
type theorems. 
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